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Bit-rate transparent watermarking 




Field of the Invention 

The present invention relates to methods and apparatus suitable for embedding 
a watermark in an mformation signal bit-stream, and in pajrticular is particularly suited, but 
not limited, to information watermarking signals which are compressed. A typical example 
5 of such a compressed information signal is an MPEG2 video signal* 

Background of the Invention 

Watermarking of information signals is a technique for the transmission of 
additional data along with the signal* For instance, watermarking techniques can be used to 

10 embed copy write and copy control iriformation into video signals. 

US 5,809,139 describes a digital watermarking method and apparatus for the 
watermarking of a digital video signal in a compressed form. To allow the system to be used 
with transmission chaonels having strict bit-rate constraints, the systraa also includes bit- 
stream control to prevent an increase in the bit-rate of the video signal. For each transform 

15 coefficient of the video signal, it is determined whether more bits will be necessary to encode 
a watennaxked version of the coefficient than an un-watermarked coefficient. If more bits 
are required to transmit a watermark coefficient, then the un-watermarked coefficient is 
output. Such a method can be used to watermark a MPEG2 video Elementary Stream (E.S.). 

Equally, a method described in WO 02/060182, by which a watermark is 

20 embedded by selectively discarding the smallest quantized DCT (Distribute Cosine 

Transform) coefficients, can be used to provide a watermarked signal that is either the same 
bit-rate as, or a lower bit-rate than, the^riginal signal. This lower bit-rate can be raised back 
to the orighial bit-rate by accumulating a relatively large amount of data sufficient to form 
one or more packets, and stuffing the packet(s) with zero bits. 

25 However, such methods are not appropriate for watermarking information bit- 

streams that are defined on the system level, for instance a Transport Stream (T.S.), as for 
instance used in Digital Video Broadcasting (DVB), or a Program Stream (P.S.), as for 
instance used in Digital Versatile Disk (DVD). 
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In T.S. and P.S., bit-rate control is more difficult because the elementary 
stream infomiation is interrupted at random places by olher data, such as other video 
stream(s), audio steam(s), system data, and timing data. In order to prevent distoMon of the 
resulting video signal, it is important that the bit-rate control is such that the position of the 
start code in the compressed video stream does not change upon the watermarking ^Ued. 
Equivalently, it is desirable that the number of bits between start codes does not change due 
to the watermark being appUed to the signal. For instance, in MPEG a change of the number 
of bits between start codes would result in system timing errors and/or result in buffer over or 

und» flow upon decoding of the bit-stream. 

It is an aim of embodiments of the present invention to provide methods and 
apparatus suitable for ^plying a watermark to an information bit-stream without changing 

the bit-rate of the information signal. 

It is a further aim of embodiments of the present invention to provide methods 
and apparatus for watermarking a Program Stream or a Transport Stream such that the 
position of start codes in the bit-stream does not change. 



Summary of the Invention 

In a first aspect the present invention pro vides a method of embedding a 
watermark in an information signal bit-stream, the method comprising the steps of: receiving 
a portion of an information signal bit-st^ea^^ storing a first copy of the received portion in a 
first buffer; watermarking a second copy of the received portion; storing the resulting 
watermarked signal in a second buffer, performing a check at predetermined intervals to 
determine if the bit-rate of the received portion has been changed by being watermarked; and 
oulputting the first copy of the received portion &om the first buffer if the check deteimines 
tihie bit-rate has changed, otherwise oulputting the watermarked signal fiwm the second buffer. 

By utilising sudi a scheme, the bit-rate of the output signal can be maintained 
at the same bit-rate as the input signal Further, by appropriate selection of the predetermined 
intervals, it is possible to ensure that positions of start codes in the bit-stream do not change. 

In another aspect, the present invention provides a computer program arranged 

to perform the method as described above. 

In a furflier aspect, the presaat invention provides a record carrier comprising a 

compute program as desraibed above. 

In another aspect, the present invention provides a method of making available 
for downloading a computer program as described above. 
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In a further aspect thie present invention provides a watermarked information 
signal formed according to the method as described above. 

In another aspect the present invention provides a record carrier comprising a 
watermarked information signal as described above. 
5 In a further aspect the present inveation provides an apparatus for embedding 

a watermark in an information signal bit-stream, title apparatus comprising: a receiver for 
receiving a portion of an information signal bit-stream; a first buffer for storing a first copy of 
the received portion; a watermarker for watemiarking a second copy of the received portion; 
a second buffer for storing the resulting watermarked signal; a controller arranged to perform 
10 a check at predetermined intervals to detemiine if the bit-rate of the received portion has been 
changed by the watermarking process; and a multiplexer arranged to oulput the first copy of 
the received portion fix>m the first buffer if the check determines the bit-rate has changed, and 
otherwise to output the watermarked signal firom the second buffer. . 

Other aspects of the information will be apparent firom the dependent claims. 

15 

Brief Description of the Drawings 

For a better understanding of the invention, and to show how embodiments of 
the same may be carried into effect, reference will now be made, by way of example, to the 
accompanying diagrammatic drawings in which: 
20 Figure 1 illustrates start code positions at diflferent levels of MPBG2 bit- 

streams: A is an Elementary Stream, B is a Packetised Elementary Stream, CI is a Program 
Stream, and C2 is aTransport Strean^ and 

Figure 2 is a schematic diagram of a remarking apparatus in accordance with 
an embodiment of tib^e present invention. 

25 

Detailed Description of Preferred Embodiment 

The present invention utilises two buffers. An information bit-stream is 
received, and one copy of tibe bit-stream is stored in a first buffer. A second copy of the same 
portion of the information bit-stream is also stored in the second buffer. The contents of the 
30 second buffer are watermarked. This watermarking can be performed whilst the signal is 

stored in the buffer, or prior to the signal being input to the buffer. The watermarking can be 
an initial watermarking of the signal, or altematively a remarking of the signal (e.g. to change 
a "copy once'* to a ''no copy** signal for copy control). 
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If; at a predetermined decision moment, the size of the bit-stream stored in the 
second buffer is equal to the size of the equivalent bit-stream stored in the first buffer, then 
the contents of the second buffer is outptit Otherwise, the contents of the first buffer is used 
as the output. 

Such a method allows the bit-rate of the output signal to be maintained at the 
same rate as the input signal, whilst still flying a watermark to at least portions of the 
signal. 

This methodology is particolarly appropriate for packetised signal streams, in 
which packets are restricted in size (either to a fixed size, or restricted to complete words). 
Noraially, to ensure that the bit-rate would be maintained, large buffers would be required to 
collect enough data to finalise a packet However, the present invention allows two smaller 
buffers to be utilised, with decisions bemg made on whether the bit-rate is maintained by 
looking at predetermined portions of each packet. Consequently, a large, relatively 
expensive, memory buffer is not required. 

If deshed, a combination (e.g. random) of the contents of the first and second 
buffer can be output, as long as the output represents a valid stream at the same bit-rate as the 
original signal. 

An MPEG2 video signal represents one example of such a packetised transport 

bit-stream. 

MPEG signals are typically formed by dividing each video image into blocks 
of 8x8 pixels, each pixel block being discrete cosine transformed into a respective block of 
DCT coefficients. In an MPEG2 elementary video stream, a number of DOT lummance 
blocks and chrominance DCT blocks constitute a macro block, a number of macro blocks 
constitutes a slice, a number of slices constitutes a picture (field or firame), and a series of 
pictures constitutes a video sequence. Some pictures are autonomously encoded (I-pictures), 
other pictures are predictively encoded with motion compensation (P- and B-pictures). In P- 
• and B-pichireSi the -DCT coeflacients represent diffiarences between pixels of the current 
picture and pixels of one or more reference pictures, rather than tide pixels themselves. 

Figure 1 illustrates a video elementary stream (ES) A, a packetised elementary 
stream (PES) B incoiporatmg tiiie elementary stream, a program stream (PS) CI incorporating 
the packetised elementary stream, and a transport stream (TS) 02 incorporating the 
packetised elementary stream. The bit-rates of CI and C2 are both higher than B, and the bit- 
rate of B is higher than A. 
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The elementary stream can be seen to comprise a plurality of slices 120 (slice 
1, slice 2y slice 3, slice 4X the data for each slice being separated by an ES start code 110. 
The slices 120 each have a respective^ non-uniform length i.e. slice 1 is longer than slice 2. 

In order to realise a complete system, the video data needs to be time 
5 multiplexed with other data, such as audio streams, system timing information, conditional 
access data etc. To allow this to occur, tiie original video elementary stream is cut into 
packets. The ES can be cut at any random position. Consequently, this may result in a 
variable length code (VLQ that is split into two portions. 

As indicated in B, each PES packet is separated from the adjacent packet by a 
10 PES start code. Each PES packet starts with a PES header, which includes decoder timing 
reference data. The packet ISO is an exasxpleofa packet within the PES stream. The packet 
ISO can be seen to include a PES start code 130, a PES header 140, as well as portions of 
various slices (the latter portion of slice 2, all of shoe 3, and the initial portion of slice 4), 
each slice being separated by a respective ES start code 1 10. • - 
IS On a system level, PES packets are typically time multiplexed with other data, 

which results in either a transport stream C2 as is used for instance in DVB or a program 
stream CI as is used for instance in DVD. PES packets are each typically upto 16kBytes in 
size. 

Streams CI and C2 in Figure 1 are typical examples of respectively a program 
20 stream and a transport stream in which the original elementary stream- has been time 

multiplexed. It will be noted that PES packets can be interrupted^ and cut into two or more 
portions at random positions, by otiier packets on the program stream level. 

For instance, in the PS example (CI) shown, each program stream packet is 
separated by a respective start code 160. Following each start code, additional data packet(s) 
2S 170 have been inserted into the PS packets 1 80, 1 82. PS packets are typically each of the 
order of several kBytes in size. Each PS packet further contains one^ or more portions of the 
PES packets e.g. PS packet 180 contains a start code 160^ an additional data packet 170, a 
portion of slice 1, separated by an ES start code firom a portion of slice 2, which is in turn 
separated by the PES start code 130 and PES header 140 £ix>m the remainder of slice 2, which 
30 is in turn separated by a further ES start code from the start of aportion of slice 3. 

In the TS example (C2) shown, each TS packet 190 comprises a header 192 
followed by a payload. TS packets are typically of a fixed, predetermined length with the TS 
header typically being of length 4 Bytes, and the payload 184 Bytes, so as to give a total 
packet length of 188 Bytes. The TS payload is thus a fraction of the lengfli of a PES packet. 
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As can be seen in Figure 1, slice 1 is fhixs split across several TS packets, as it is too large to 

be accommodated within a single TS packet. The payload may comprise information from 

the PES, along with additional system information 194; 

During the encoding process, special rules are utilised to ensure that the start 
5 codes are vmique at each compressed stream level. For instance, in MPEG a start code 

consists of 23 logical "0", followed by a logical "1'* (in hexadecimal notation 0x00 00 01). If 

the position of the start codes are changed, this is likely to result in errors upon decoding e.g. 

due to changing the system timing ., resulting in buffer underflow or overflow. 

A preferred embodiment of the present invention will now be described. The 
10 preferred embodiment makes use of two buffers, with the original incoming stream (without 

a watermark) being stored in a j5rst buffer, and the remarked stream (witii a watermark 

added) being stored in the second buffer. After a predetermined time, which is maximally 

after the information signal has filled the buffos, it is decided to output data either from 

buffer 1 (unmarked data) or from buffer 2 (remarked data). The buffer selection is based on 
1 5 the fact on whether it is possible or not to restore the bit-rate (i.e. arrive at a zero bit budget 

value at the decision moment). As will be seen by the below embodiment, decision moments 

are typically at a slice level (e.g. at the start or end of each slice). 

In the embodiment, it is assumed that a watermark is added to a respective 

compressed video stream by using the run-merge algorithm described, for instance, in WO 
20 02/0601 82. During the processing of data, the run-merge algorithm discards bits and 

consequently can reduce the bit-rate. The total number of discarded bits at any moment 

during processing is stored^ and is termed the *1)it budget*'. 

It win be appreciated that other watermarking systems could equally be used 

tiiat can be applied so as to maintain and/or reduce the number of bits within an information 
25 signal. 

Figure 2 illustrates a watermarking apparatus suitable for watermarking an 
MPEG2 information bit-stream in accordance with the preferred embodiment of the present 
invention. The apparatus in this particular embodiment is termed a ^^emarker", as it is used 
to add a watermark to a signal that has already been watermarked. However, the apparatus 
30 could also be used to apply a first watermaric to an information signal. 

The incoming information bit-stream is received at input 210. One copy of the 
incoming stream is passed to buffer 1 220, which acts as a normal FIFO (First In First Out) 
buffer. 
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A second copy of the incoming bit-stream is passed, via watemiark embedding 
apparatus 230, to buffer 2 240 (which is also a FIFO). The second buffer 240 thus acts to 
store parts of the remarked compressed video stream; 

In this embodiment, the bixffers are of identical size, and are sized such that 
5 normally one or more sUces can be stored in each buffer. Preferably, the buffers are sized 
such that an integral number of slices can be stored in each buffer. Simulations show that, 
for MPEG2, a buffer size of approximately 2-4kByte is appropriate. 

The watermark embedding apparatus 230 consists of a filter 232 and a 
remarker 234. The filter 232 acts to remove the information specific to the system level of 
10 the stream (i.e. the TS or PS specific start codes and/or data), and to leave the ES specific 

data. The remarker 234 acts to embed the wateraiark into the ES data, in accordance with the 
above-discussed run-merge algorithm, and then to add back in the relevant TS/PS data that 
had been removed by the filter 232, and to output the resulting watermarked version of the 
original bit-stream to buffer 240. 
15 A counter 242 is coimected to buffer 240. The coimter is incremented each 

time that a remarked slice is completely stored in buffer 2. The same counter decrements 
each time that a remarked slice is removed firom buffer 2. 

A start code detector is connected to the output of buffer 1 . At the instant that 
a new slice start is detected at the output to buffer 1, a check is made on whether the 
20 equivalent slice is already completely present in buffer 2 (Le. the counter value should not be 
0). 

A multiplexer is coxmected to the outputs of both buffers 220, 240. The 
multiplexer operates to selectively output (to output 270) the contents of either buffer 1 or 
buffer 2, based upon the counter value 242 and the slice start detector 260. 
25 If the value of the coimter 242 is more than 0 when a new slice is detected, the 

output multiplexer will select data firom buffer 2 240, and thus a remarked (watermarked) 
slice will be output 

If the counter value is 0 at the moment that a slice start is detected to the 
output of buffer 1, the output multiplexer will select data fiom buffer 1, and thus unmarked 
3 0 data will be output 

In either case, the eqidvalent portion of the output signal is also removed firom 
the other buffer, to stop redundant data accumulating. 

It will be appreciated that tiie number of slices not watermarked will be 
dependent upon buffer size. For instance, the number of unmarked slices will be higher for ' 
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relatively small buffer sizes (e.g. 2kByte), and also for large slice sizes (e.g. for I-pictures at 
high bit-rates). 

Various embodiments of the present invention will be apparent to the skilled 
person. For instance, the watermark can be applied to the information bit-stream by 
5 transcoding (i.e. direct appUcation of the watermark to the bit stream), such that the bit 
stream does not have to be decoded and re-encoded to add the watermark. 

It will be appreciated by the skilled p^son tihat various implraientations not 
specifically described will be understood as falling wiftiin the scope of the present invCT.tion. 
For instance, whilst only the functionally of the embedding apparatus has been described, it 
10 will be appreciated tibiat the apparatus could be realised as a digital circuit, an analog circuit, a 
computer program or a combination thereof. 

Such computer programs, as well as any watermarked signals generated by the 
embedding method of the present invention, can be stored on any machine readable medium 
(e.g. a computer memory, a floppy disk, a compact disc or the equivalent), or can be 
15 transmitted along any transmission medium, including both wireless and wireline medium. 
The term record carrier in the present specification is taken to include both such machine 
readable medium and such transmission medium. 

Within the specification it will be appreciated that the words '"comprising" 
does not exclude other elements or stqps, that *'a'* or ' W does not exclude a plurality, and 
20 that a single processor or other unit may fulfil the functions of several means recited in the 



claims, abstract and drawings), and/or all of the steps of any method or process so disclosed, 
may be combined in any combination, except combinations where at least some of such 

25 features and/or steps are mutually exclusive. 

Each feature disclosed in this specification (including any accompanying 
claims, abstract and drawings), may be replaced by alternative features serving the same, 
equivalent or similar purpose, unless expressly stated otherwise. Thus, unless expressly stated 
otherwise, each feature disclosed is one example only of a generic series of equivalent or 

30 similar features. 

The invention is not restricted to the details of the foregoing enibodiment(s). 
The invention extends to any novel one, or any novel combination, of the features disclosed 
in this specification (includiag any accompanying claims, abstract and drawings), or to any 
novel one, or any novel combination, of the steps of any method or process so disclosed. 



claims. 



All of the features disclosed in this specification (including any accompanying 
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CLAIMS: 





1 . A mefhod of embedding a watermark in an information signal bit-stfi^^ the 
method comprismg the steps of: 

receiving a portion of an information signal bit-stream; 
storing a first copy of the received portion in a first bujBfer; 
5 watermarking a second copy of the received portion; storing the resulting 

watemiarked signal in a second buffer; 

performing a check at predetermined intervals to deteraiine if the bit-rate of 
the received portion has been changed by being watermarked; and 

outpntting the first copy of the received portion firom the first buffer if the 
10 check detOTnines the bit-rate has changed, otherwise ou^utting the watermarked signal fix)m 
ihs second buffer. 

2. A method as claimed in claim 1, wherein said watermarking step comprises 
embedding a watermark in the second copy of the received portion by transcoding. 

15 

3. A method as claimed in claim 1, wherein said information signal c0mprises at 

I 

least one of a transport stream and a program stream. 

4. A method as claimed in claim 1, wherein said information signal bit-stream 
20 comprises a series of packets^ the predetermined interval corresponding to the first buffer 

receiving an integral numb^ of said packets. 

5. A method as claimed in claim U wherein said predetermined interval is when 
a predetermined start code of the bit-stream is detected at a predetermined position within the 

25 first buffer. 



6. A method as claimed in claim 1 » whmin said predetermined interval 

corresponds to at least one of the buffers being filled by a respective stored signal. 
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7. A computer program airanged to perform the method as claimed in claim 1 . 

8. A record carrier ccHnprisiBga<K)mputer program as claimed in claim?. 

5 9. A method of making available for downloading a computer program as 

claimed in claim?. 

■ 

10. A watermarked information signal formed according to the method as claimed 
in claim 1. 

10 

11. A record carrier comprising a watermarked information signal as claimed in 
claimlO. 

12. An £^paratus for embedding a watermark in an information signal bit-stream. 



IS the apparatus comprising: 

a receiver for receiving a portion of an information signal bit-stream; 
a first buffer for storing a first copy of the received portion; 
a watermarker for watermarking a second copy of the received portion; 
a second buffer for storing the resulting watermarked signal; 
20 a controller arranged to perform a check at predetermiaed intervals to 

determine if the bit-rate of the received portion has been changed by the watermarking 
process; and 

a multiplex^ arranged to output the first copy of the received portion firom the 
first buffer if the check determines the bit-rate has changed, and otherwise to output the 
25 watermarked signal £x>m the second buffer. 
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ABSTRACT: 





^« fa 




A method and apparatus(200) for embedding a watermark in an infori^^on 
signal bit-stream are described. The method comprises receiving a portion of an information 
signal bit-stream (MPEG2). A first copy of the received portion is stored in a first buffer 
(220). A second copy of the received portion is watermarked, and the resvilting watermarked 
signal stored in a second buffer (240). At predetermined intervals, a check is performed to 
determine if the bit-rate of the received portion has been changed by being watermarked. If 
the check determines the bit-rate has changed, the first copy of the received portion firom the 
first buffer is output. Otherwise the watermarked signal from the second buffer is output. 



10 [Figure 2] 
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